PERL: Pivot-based Domain Adaptation for Pre-trained Deep Contextualized Embedding Models
نویسندگان
چکیده
منابع مشابه
Neural Domain Adaptation with Contextualized Character Embedding for Chinese Word Segmentation
There has a large scale annotated newswire data for Chinese word segmentation. However, some research proves that the performance of the segmenter has significant decrease when applying the model trained on the newswire to other domain, such as patent and literature. The same character appeared in different words may be in different position and with different meaning. In this paper, we introdu...
متن کاملUnregistered Multiview Mammogram Analysis with Pre-trained Deep Learning Models
We show two important findings on the use of deep convolutional neural networks (CNN) in medical image analysis. First, we show that CNN models that are pre-trained using computer vision databases (e.g., Imagenet) are useful in medical image applications, despite the significant differences in image appearance. Second, we show that multiview classification is possible without the pre-registrati...
متن کاملDeep Unsupervised Domain Adaptation for Image Classification via Low Rank Representation Learning
Domain adaptation is a powerful technique given a wide amount of labeled data from similar attributes in different domains. In real-world applications, there is a huge number of data but almost more of them are unlabeled. It is effective in image classification where it is expensive and time-consuming to obtain adequate label data. We propose a novel method named DALRRL, which consists of deep ...
متن کاملSparse Embedding-based Domain Adaptation for Object Recognition
Domain adaptation algorithms aim at handling the shift between source and target domains. A classifier is trained on images from the source domain; and the classifier recognizes objects in images from the target domain. In this paper, we present a joint subspace and dictionary learning framework for domain adaptation. Our approach simultaneously exploits the low-dimensional structures in two do...
متن کاملLatent Domain Phrase-based Models for Adaptation
Phrase-based models directly trained on mix-of-domain corpora can be sub-optimal. In this paper we equip phrase-based models with a latent domain variable and present a novel method for adapting them to an in-domain task represented by a seed corpus. We derive an EM algorithm which alternates between inducing domain-focused phrase pair estimates, and weights for mix-domain sentence pairs reflec...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Transactions of the Association for Computational Linguistics
سال: 2020
ISSN: 2307-387X
DOI: 10.1162/tacl_a_00328